Fundamental Limits of Lossless Data Compression With Side Information
نویسندگان
چکیده
The problem of lossless data compression with side information available to both the encoder and decoder is considered. finite-blocklength fundamental limits best achievable performance are defined, in two different versions problem: Reference-based compression, when a single string used repeatedly compressing source messages, pair-based where for each message. General achievability converse theorems established arbitrary source-side pairs. Nonasymptotic normal approximation expansions proved optimal rate reference-based settings, memoryless sources. These stated terms explicit, bounds, that tight up third-order terms. Extensions go significantly beyond class sources obtained. relevant dispersion identified its relationship conditional varentropy established. Interestingly, it general smaller.
منابع مشابه
Rényi information dimension: fundamental limits of almost lossless analog compression
In Shannon theory, lossless source coding deals with the optimal compression of discrete sources. Compressed sensing is a lossless coding strategy for analog sources by means of multiplication by real-valued matrices. In this paper we study almost lossless analog compression for analog memoryless sources in an information-theoretic framework, in which the compressor or decompressor is constrain...
متن کاملOptimal Universal Lossless Compression with Side Information
This paper presents conditional versions of Lempel-Ziv (LZ) algorithm for settings where compressor and decompressor have access to the same side information. We propose a fixed-length-parsing LZ algorithm with side information, motivated by the Willems algorithm, and prove the optimality for any stationary processes. In addition, we suggest strategies to improve the algorithm which lower the d...
متن کاملSecure distributed lossless compression with side information at the eavesdropper
This paper investigates the problem of secure distributed lossless compression in the presence of arbitrarily correlated side information at an eavesdropper. This scenario consists of two encoders (referred to as Alice and Charlie) that wish to reliably transmit their respective (correlated) sources to a legitimate receiver (referred to as Bob) while satisfying some requirement on the equivocat...
متن کاملLossy data compression: nonasymptotic fundamental limits
The basic tradeoff in lossy compression is that between the compression ratio (rate) and the fidelity of reproduction of the object that is compressed. Traditional (asymptotic) information theory seeks to describe the optimum tradeoff between rate and fidelity achievable in the limit of infinite length of the source block to be compressed. A perennial question in information theory is how relev...
متن کاملUniversal lossless data compression with side information by using a conditional MPM grammar transform
A grammar transform is a transformation that converts any data sequence to be compressed into a grammar from which the original data sequence can be fully reconstructed. In a grammar-based code, a data sequence is first converted into a grammar by a grammar transform and then losslessly encoded. Among several recently proposed grammar transforms is the multilevel pattern matching (MPM) grammar ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 2021
ISSN: ['0018-9448', '1557-9654']
DOI: https://doi.org/10.1109/tit.2021.3062614